Improving Hit-and-Run for global optimization
نویسندگان
چکیده
Improving Hit-and-Run is a random search algorithm for global optimization that at each iteration generates a candidate point for improvement that is uniformly distributed along a randomly chosen direction within the feasible region. The candidate point is accepted as the next iterate if it offers an improvement over the current iterate. We show that for positive definite quadratic programs, the expected number of function evaluations needed to arbitrarily well approximate the optimal solution is at most O(n 5~2) where n is the dimension of the problem. Improving Hit-and-Run when applied to global optimization problems can therefore be expected to converge polynomially fast as it approaches the global optimum.
منابع مشابه
Pattern discrete and mixed Hit-and-Run for global optimization
We develop new Markov chain Monte Carlo samplers for neighborhood generation in global optimization algorithms based on Hit-and-Run. The success of Hit-and-Run as a sampler on continuous domains motivated Discrete Hit-and-Run with random biwalk for discrete domains. However, the potential in efficiencies in the implementation, which requires a randomization at each move to create the biwalk, le...
متن کاملAdaptive parameterized improving hit-and-run for global optimization
We build on improving hit-and-run’s (IHR) prior success as a Monte Carlo random search algorithm for global optimization by generalizing the algorithm’s sampling distribution. Specifically, in place of the uniform step-size distribution in IHR, we employ a family of parameterized step-size distributions to sample candidate points. The IHR step-size distribution is a special instance within this...
متن کاملA generalization of the Solis–Wets method
In this paper we focus on the application of global stochastic optimization methods to extremum estimators. We propose a general stochastic method—the master method —which includes several stochastic optimization algorithms as a particular case. The proposed method is sufficiently general to include the Solis–Wets method, the improving hit-and-run algorithm, and a stochastic version of the zigz...
متن کاملDirection Choice for Accelerated Convergence in Hit-and-Run Sampling
Hit-and-Run algorithms are Monte Carlo procedures for generating points that are asymptotically distributed according to general absolutely continuous target distributions G over open bounded regions S. Applications include nonredundant constraint identification, global optimization, and Monte Carlo integration. These algorithms are reversible random walks which commonly apply uniformly distrib...
متن کاملA Hit-and-Run approach for generating scale invariant Small World networks
Hit-and-Run is a well-known class of Markov chain algorithms for sampling from essentially arbitrary distributions over bounded regions of the Euclidean space. We present a class of Small World network models constructed using Hit-and-Run in a Euclidean ball. We prove that there is a unique scale invariant model in this class that admits efficient search by a decentralized algorithm. This resea...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- J. Global Optimization
دوره 3 شماره
صفحات -
تاریخ انتشار 1993